Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

1/25 



EL977166394US 





Memory 
124 






Modem 
122 





0) 



iZ ^ 



o 
o 



O 




Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

2/25 






CD 



1 
CD ^ 

il ^ 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

3/25 



BUNDLES 302 










INSTRUCTION CACHE 
300 


f 






SIGNALS 


▼ 




PERFORMANCE 
MONITOR UNIT 
306 





304 



Figure 3 







PERFORMANCE 


CACHE 




INDICATOR 


402 




SHADOW CACHE 






404 








PROCESSOR 




400 



Figure 4 



500 



127 


87 


86 46 


45 


5 


4 0 


slot 2 1 


slot 1 | 


slotO I 


Template 



r 



\ 41 



506 



514 



504 



T 



41 



512 



502 



510 



508 



Figure 5 



SUBROUTINE 
600 



602 



604 



606 



DATA 
610 



\ 



612 



614 



Figure 6B 



Figure 6A 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

4/25 



START 



RECEIVE BUNDLE 
700 



I 



IDENTIFY INSTRUCTION IN BUNDLE 

702 



PERFORMANCE 
INDICATOR ASSOCIATED 
WITH INSTRUCTION 
PRESENT? 
704 



YES 



NO 



SEND SIGNAL TO PERFORMANCE 
MONITOR UNIT 
706 



I 



PROCESS INSTRUCTION 
708 



YES 



MORE 
UNPROCESSED 
INSTRUCTIONS IN BUNDLE? 

710 



C START ) 



RECEIVE BUNDLE 
800 



I 



IDENTIFY INSTRUCTION IN BUNDLE 

802 



PERFORMANCE 
INDICATOR ASSOCIATED 
WITH INSTRUCTION IN 
BUNDLE? 
804 



YES 



NO 



SEND SIGNAL TO INTERRUPT UNIT 

806 



I 



PROCESS INSTRUCTION 
808 



YES 



MORE 
UNPROCESSED 
INSTRUCTIONS IN BUNDLE? 

810 



NO 



NO 



c 



END 



c 



END 



Figure 7 



Figure 8 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

5/25 



( START ) 



IDENTIFY REQUEST TO ACCESS 
A MEMORY LOCATION 
900 



c 



START 



RECEIVE 
INSTRUCTION WITH 
INDICATOR? 
1100 



YES 



PERFORMANCE 
INDICATOR ASSOCIATED 
WITH MEMORY 
LOCATION? 
902 



YES 



GENERATE INTERRUPT 
904 



PROCESS MEMORY LOCATION ACCESS 

906 



c 



I 



SIGNAL SET TO START COUNTING 
EVENTS FOR INSTRUCTIONS 

1102 



RECEIVE 
INSTRUCTION WITH 
INDICATOR? 
1104 



YES 



END 



Figure 9 



SIGNAL RESET TO STOP 
COUNTING EVENTS 
1106 



Figure 1 1 



( START ) 



RECEIVE SIGNAL PROBE 
1000 



I 



COUNT EVENTS ASSOCIATED WITH 
INSTRUCTION BEING PROCESSED 

1002 



c 



I 



END 



Figure 10 



Atty. Docket* AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

6/25 



c 



START 



I 



3 



CHECK FLAG 
1200 




f START ) 



RECEIVE INSTRUCTIONS 
ASSOCIATED WITH 
PERFORMANCE INDICATOR 
1300 



NO 



YES 



SEND SIGNAL TO PERFORMANCE 
MONITOR UNIT TO ENABLE 
COUNTING OF EVENTS 
1204 



IDENTIFY THRESHOLD FOR 
INSTRUCTION 
1302 



MONITOR CYCLES 
1304 



SEND SIGNAL TO PERFORMANCE 
MONITOR UNIT TO DISABLE 
COUNTING OF EVENTS 
1206 



c 



END 



3 



NO 



THRESHOLD 
EXCEEDED FOR 
INSTRUCTION? 
1306 



YES 



PERFORM SELECTED ACTION 

1308 



Figure 12 




NO 



YES 



SEND COLLECTED 
INFORMATION TO 
MONITORING PROGRAM 
1312 



c 



END 



Figure 13 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

7/25 



c 



START 



I 



RECEIVE DATA ASSOCIATED WITH 
PERFORMANCE INDICATOR 
1400 



MEMORY 
LOCATION ACCESSED? 
1402 



YES 



INCREASE COUNTER 
1404 




Figure 14 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

8/25 



COMPILER 
1500 



SHADOW MEMORY 
1505 




PERFORMANCE 
MONITOR SECTION 
1506 



META DATA 



INSTRUCTIONS 
1502 



MEMORY LOCATION 
1512 



1504 



Figure 



1612 



text 1 



1600 



1602 



1604 



1606 



1608 



1610 




# of entries 
Entry 1 offset 
entry length 
Flags 

Entry 2 offset 
entry length 
Flags 



{Entry 3 offset 
entry length 
Flags 




1 




Entry 4 offset 
entry length 
Flags 

Entry 5 offset 
entry length 
Flags 



5 
0 

120 1616 

Count all instructions in this range 

124 
4 

Take exception > — . -)618 



160 
4 

threshold, granularity 100 cycles 



256 
4 

start tracing 



1614 



1622 



512 
4 

stop tracing 



1620 



1624 



Figure 16 



Atty. Docket # AUS920030490US1 
DeWitt etal. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

9/25 



EXISTING CACHE 



1702 



PRIMARY 
SEGMENT 



1700 



PERFINST 
1728 SEGMENT 



NEW SHADOW CACHE 



LOAD 



1730 



1732 



1734 



1736 



1738 



1740 



1742 



1744 



1746 



1748 



1750 



1752 




1704 



1706 



1708 



1710 



1712 



1714 



1716 



1718 



1720 



1722 



1724 



TRANSLATION 
TABLE 



Figure 17 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 



c 



START 



3 



IDENTIFY AN INSTRUCTION 
FOR PROFILING 
1800 



I 



GENERATE META DATA FOR 
INSTRUCTION 
1802 



ASSOCIATE META DATA 
WITH INSTRUCTION 
1804 



YES 



MORE 
INSTRUCTIONS? 
1806 



NO 



c 



END 



3 



Figure 18 



10/25 



YES 



c 



START 



£ 



DETECT ACCESS TO 
MARKED DATA AREA 
1900 



I 



GENERATE META DATA 
FOR MEMORY LOCATION 
1902 



I 



ASSOCIATE META DATA 
WITH MEMORY LOCATION 
1904 




Figure 19 



C 



START 



I 



D 



EXECUTE INSTRUCTION 
2000 



r START J 



ACCESS MEMORY LOCATION 

2100 





Figure 20 



Figure 21 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

11/25 



ANALYSIS 
TOOL 
2216 



OPERATING SYSTEM 
2214 



HARDWARE INTERFACE 



Figure 22 



INSTRUCTION UNIT 
2200 



2212 



INSTRUCTION 



COUNTER 



2202 



2204 



2208 



DATA 



COUNTER 



DATA UNIT 
2206 



2210 



PROFILER 

2300 



I 



ANALYSIS TOOL 
2306 



PROGRAM 



SUBROUTINE 
2304 



Figure 23 



PROCESSOR 
2308 



2302 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

12/25 



c 



START 



IDENTIFY INSTRUCTIONS OF INTEREST 
USING DATA FROM PROFILER 

2400 



SELECT INSTRUCTION FOR MODIFICATION 

2402 



1 



DYNAMICALLY ADD PERFORMANCE 
INDICATOR TO SELECTED INSTRUCTION 

2404 



YES 



MORE 
INSTRUCTIONS FOR 
MODIFICATION? 
2406 



NO 



( END ) 

Figure 24 



2500 



SCANNING 




DAEMON 


^ ) 


2508 






PROCESSOR 
2510 



Figure 25 



Atty. Docket # AUS920030490US1 
DeWitt etal. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

13/25 



c 



START 



I 



IDENTIFY PAGES 
2600 



I 



SELECT A PAGE 
2602 



ASSOCIATE INDICATORS FOR ALL 
INSTRUCTIONS IN PAGE 
2604 



I 



EXECUTE PROGRAM 
2606 



ALL 

PAGES SCANNED? 

2608 



NO 



SELECT NEXT PAGE 
2610 



c 



END 



Figure 26 



YES 



2702b 
2702a 




2704b 




2706a 



2708b 



2704a 




2706b 




2708a 



Figure 27 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 



( START ) 



14/25 



c 



START 



IDENTIFY CALL AND RETURN 
INSTRUCTIONS 
2800 



I 



ASSOCIATE MONITORING INDICATOR 
WITH CALL AND RETURN INSTRUCTIONS 

2802 



I 



EXECUTE PROGRAM 
2804 



I 



COLLECT DATA 
2806 



c 



I 



DETECT 
EXECUTION OR 
INSTRUCTION? 
2900 



YES 



NO 



INCREMENT COUNTER FOR 
INSTRUCTION 
2902 



NO 



END 



3 



COUNTER > 
THRESHOLD? 
2904 



YES 



FIGURE 28 



START 



SEND INTERRUPT TO 
MONITORING PROGRAM 
2906 



I 



EXAMINE CALL STACK AND IDENTIFY 
CALLER OF ROUTINE 
3000 



I 



c 



I 



END 



J 



FIGURE 29 



CAPTURE NUMBER OF INSTRUCTIONS 

EXECUTED 

3002 



I 



RESET COUNTER 
3004 



I 



RETURN CONTROL FROM INTERRUPT 

3006 



c 



I 



END 



FIGURE 30 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

15/25 



PROGRAM 



3100 




3102 



3104 




INSTRUCTION CACHE 3106 



RANGE REGISTERS 3108 



COUNTER 3110 



FIGURE 31 



3112 



3114 



c 



START 



3 



IDENTIFY INSTRUCTION 
FOR EXECUTION 
3200 



INSTRUCTION 
.WITHIN SET RANGE?. 
3202 



YES 



NO 




INCREMENT EXECUTION 
COUNTER 
3208 



FIGURE 32 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

16/25 



BEGIN 



I 



EXECUTE CODE WHILE 
PROCESSING PERFORMANCE 
INDICATORS AND COUNTING 

EVENTS OF INTEREST 

3302 



I 



READ PERFORMANCE 
MONITOR VALUES 
3304 




EXECUTE CODE FOR 
MATCHING CONDITION 
3308 



EXECUTE CODE FOR 
FAILED CONDITION 
3310 



c 



END 



3 



Figure 33 



OBJECT CODE FOR SUBROUTINE 

3402 



INSTRUCTIONS ASSOCIATED WITH 
PERFORMANCE INDICATORS 
(AND/OR INSTRUCTIONS THAT ACCESS 
DATA ASSOCIATED WITH PERFORMANCE 

INDICATORS) 
3404 



INSTRUCTIONS FOR OBTAINING OR READING 
PERFORMANCE MONITOR COUNTERS 

3406 



INSTRUCTIONS FOR COMPUTING 
CONDITIONS USING VALUES FROM 
PERFORMANCE MONITOR COUNTERS 

3408 



INSTRUCTIONS FOR BRANCHING TO 
APPROPRIATE SETS OF INSTRUCTIONS 
BASED ON COMPUTED CONDITIONS 

3410 



INSTRUCTIONS FOR ACTIONS BASED ON 
FIRST CONDITION 
3412 



INSTRUCTIONS FOR ACTIONS BASED ON 
SECOND CONDITION 
3414 



INSTRUCTIONS FOR ADDITIONAL 
PROCESSING 
3416 



Figure 34 



Atty. Docket # AUS920030490US1 
DeWitt et al. 

Method and system for autonomic performance improvements 
in an application via memory relocation 

17/25 

3502 Subroutine ProcessData { 



3530 'v ##PerfMon CACHE_MISS, CACHE_HIT; 

3504 ^n_, call GetData(dataStructure, numberDataltems); 

3506 'v call PerfMon_Read(valueA, CACHE_MISS,'-^ 3508 

valueB, CACHE_HIT); ^ 3510 

3512 3514 

3516 ^ if (valueA > valueB) then 3 ^ 20 

3518 ^ call ModifyDataStructure(ADJUST, dataStructure); 

3522 ^ else if (valueA > (SCALE_CACHE_MISS*numberDataltems)) then 
3524 ^ call ModifyDataStructure(RENEW, dataStructure); 

3528 call SortNewData(dataStructure) 3 5 26 
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